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BACKGROUND OF THE INVENTION 
Field of the Invention 

This invention relates generally to devices for browsing information on an 
information network. More specifically, this invention relates to a portable system for 
accessing personalized information on an information network using audio for both 
input and output. 

Description of the Related Art 

A number of different information networks are available that allow access to 
information contained on their computers, with the Internet being one that is generally 
known to the public. While the Internet is used herein as an example of how the 
present invention is utilized, it is important to recognize that the present invention is 
also applicable to other information networks. For those who are not familiar with the 
Internet, the world-wide web, web servers, and web browsers, a brief overview of 
these concepts is presented here. 

An example of a typical Internet connection found in the prior art is shown in 
Fig. 1 . A user that wishes to access information on the Internet typically has a 
computer workstation 1 12 that executes an application program known as browser 
1 14. Workstation 1 12 establishes a communication link 116 with web server 118 
such as a dial-up wired connection with a modem, a direct link such as a Tl or ISDN 
line, or a wireless connection through a cellular or satellite network. When the user 

- 1 - 

548999 v3 



Atto cketNo.: M-7844 US 

enters a request for information by entering commands in browser 114, workstation 
112 sends a request for information, such as a search for documents pertaining to a 
specified topic, or a specific web page to web server 118. Each web server 118, 120, 
122, 124 on the Internet has a known address which the user must supply to the 
5 browser 1 14 in order to connect to the appropriate web server 118, 120, 122, or 124. 
If the information is not available on the user's web server 1 1 8, a central link such as 
backbone 126 allows web servers 120, 122, 124 to communicate with server 1 18 to 
supply the requested information. Because web servers 118, 120, 122, 124 can 
contain more than one web page, the user will also specify in the address which 
10 particular web page he wants to view. The web servers 118, 120, 122, 124 execute a 
web server application program which monitors requests, services requests for the 
information on that particular web server, and transmits the information to the user's 
workstation 112. 

In the prior art, a web page is primarily visual data that is intended to be 

15 displayed on the display device, such as the monitor of user's workstation 112. When 
web server 118 receives a web page request, it will transmit a document, generally 
written in a markup language such as hypertext markup language (HTML), across 
communication link 1 16 to the requesting browser 114. Communication link 116 
may be one or a combination of different data transmission systems, such as a direct 

20 dial-up modem connected to a telephone line, dedicated high-speed data links such as 
Tl or ISDN lines, and even wireless networks which transmit information via satellite 
or cellular networks, Browser 114 interprets the markup language and outputs the 
web page to the monitor of user workstation 112. This web page displayed on the 
user's display may contain text, graphics, and links (which are addresses of other web 

25 pages.) These other web pages (i.e., those represented by links) may be on web server 
1 18 or on different web servers 120, 122, 124. The user can go to these other web 
pages by clicking on the links using a mouse or other pointing device. When web 
server 1 1 8 receives a search request, the request is sent to the server containing the 
search engine specified by the user. The search engine then compiles one or more 

30 pages containing a list of links to web pages on other web servers 120, 122, 124 that 
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may contain information relevant to the user's request. The search engine transmits 
the page(s) in markup language back to the requesting web server. This entire system 
of web pages with links to other web pages on other servers across the world is known 
as the "World Wide Web". 

5 Data processing systems are connected to the Internet's hardware network 

using several different types of communication technologies. 

As the capabilities, usefulness, and amount of information available on the 
Internet increases, it is desirable to have the ability to access the Internet from any 
location at any time. One known solution is to use wireless mobile communication 
1 0 systems with portable devices such as laptop or palmtop computers. The user enters 
commands and requests using a keyboard or other known data entry device. The 
results of the request/command are then output to the device's display. The wireless 
system transfers data between the server and the user's portable device while the user 
is free to move about an area. 

1 5 There are situations, however, when it would be more convenient for the user 

to enter commands and requests orally without being required to enter the information 
through a keyboard or other entry device, and to receive the information verbally 
without looking at a display for the results. Such situations arise, for example, when a 
user is operating machinery, such as driving a car, where the user cannot take his 

20 hands off the controls to enter commands or divert his attention to view a display. 
Thus it is desirable to provide a mobile system that allows the user to request and 
receive information from the Internet vocally, so that the user may simultaneously 
perform other tasks. 

In the prior art, auto makers are currently capable of providing embedded 
25 microprocessor systems that respond to a verbal request such as providing audio 
readout of sensed data including RPM, fuel level, mileage rate, and ambient air 
temperature, raise and lower windows, and driving instructions to a destination. It is 
also known that systems are being developed for automobiles that are capable of 
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delivering audio information in response to a user's verbal request to retrieve e-mail 
from an Internet account, or other information from subscription news services. The 
known systems do not, however, allow a user to customize information preferences 
ahead of time, and are not capable of browsing virtually any address on an 
5 information network such as the Internet. The known systems also are not capable of 
outputting information that arrives from an information network in markup language 
or speech format. 



SUMMARY OF THE INVENTION 

10 In one embodiment, the present invention is a mobile information network 

browser device with audio feedback capability that is capable of transmitting a request 
for information via a wireless communication interface from one or more servers in an 
information network. The browser device further includes an audio interface capable 
of receiving data from the wireless communication interface that is responsive to the 

1 5 request for information. The browser device interfaces with a wireless 

communication network so that it may be used in a mobile vehicle, such as an 
automobile. Receiving the requested information in audio format relieves the user 
from having to view an output display screen to receive the information while trying 
to operate the mobile vehicle. 

20 The mobile browser device may be preprogrammed with default requests for 

information, however, in another embodiment, the browser device further includes a 
voice interaction system that recognizes commands from a user's speech including 
requests for information. 

One feature of the mobile audio device is an audio converter that receives 
25 information responsive to the request, and converts the responsive information to an 
audio signal for output to an audio output device. The audio output device may be an 
audio speaker, a set of headphones, a short-range wireless radio which broadcasts the 
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audio signal to a channel on a car radio, and/or a cassette adapter which is capable of 
recording the audio output signal. 

Another feature in an embodiment of the browser device is a microphone for 
receiving speech input from the user. 

Another feature of the browser device is a set of program instructions for 
converting the responsive information from a text format to an audio format which 
may be loaded and executed in the network server, or in a processor associated with 
the audio interface. 

In another embodiment, the browser device includes program instructions for 
encrypting the user input prior to being transmitted to the wireless communication 
interface, decrypting the responsive information, compressing the user input prior to 
being transmitted to the wireless communication interface, and decompressing the 
responsive information. 

In yet another embodiment, the browser device includes program instructions 
for allowing the user to enter personal information to customize interaction with the 
browser device, to customize interaction with the browser device, and to enter 
personal information to customize interaction with the browser device. 

Another feature of the present invention is an input buffer for storing the 
responsive information until the user commands the browser device to playback the 
responsive information, and/or until the audio converter processes it. 

Another feature of the present invention is a position-keeping system for 
providing the location of the mobile audio device to the network server via the 
wireless communication network, wherein the responsive information is based on the 
location of the mobile audio device. 
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A system within which the present invention for a mobile browser may be 
utilized includes a wireless communication network, and one or more data processors 
in communication with the wireless communication network. The data processor 
executes program instructions for receiving a user's input, requesting information 
5 from the information network, receiving responsive information from the information 
network, and transmitting the responsive information received from the information 
network. The system further includes an audio output device to output the responsive 
information to the user in audio format. 

In another embodiment, the system includes a mobile or convention telephone 
10 in communication with the voice interaction system for receiving the user's speech 
input. 

In another embodiment, the system includes a position-keeping system for 
providing the location of the mobile audio device to the information network via the 
wireless communication network. The system is then able to provide responsive 
1 5 information based on the location of the mobile audio device. 

The foregoing has outlined rather broadly the objects, features, and technical 
advantages of the present invention so that the detailed description of the invention 
that follows may be better understood. 

BRIEF DESCRIPTION OF THE DRAWINGS 

20 Figure 1 is a block diagram of a system for accessing an information network 

found in the prior art. 

Figure 2 is a diagram of one embodiment of a system for accessing an 
information network in accordance with the present invention. 

Figure 3a is a flowchart diagram of logic for handling user input in a mobile 
25 audio device in accordance with the present invention. 
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Figure 3b is a flowchart diagram of logic in a mobile audio device for 
handling information requested from an information network in accordance with the 
present invention. 

Figure 4 is a flowchart diagram of logic in a voice interaction system for 
5 accessing an information network in accordance with the present invention. 

Figure 5 is a flowchart diagram of logic for entering personal information in a 
personalization server in accordance with the present invention. 

Figure 6 is a flowchart diagram of logic for requesting information from a 
content server in accordance with the present invention. 

, 10 Figure 7 is a block diagram of one embodiment of a mobile audio device in 

accordance with the present invention. 

Figure 8 is a block diagram of a voice recognition system for accessing an 
information network as found in the prior art. 

Figure 9 is a diagram of another embodiment of a system for accessing an 
1 5 information network in accordance with the present invention. 

Figure 10 is a block diagram of another embodiment of a mobile audio device 
in accordance with the present invention. 

Figure 1 1 is a schematic diagram of components included in one embodiment 
of the present invention for a mobile audio browsing device. 

20 The present invention may be better understood, and its numerous objects, 

features, and advantages made apparent to those skilled in the art by referencing the 
accompanying drawings. The use of the same reference symbols in different drawings 
indicates similar or identical items. 
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The method and apparatus of the present invention is applicable to mobile and 
portable devices that are capable of accessing a computerized information network. 
The present invention provides a mobile device that allows the user to access an 
5 information network while the user is mobile, to request information using voice 

commands, and to receive information responsive to the request in audio format. The 
present invention thereby alleviates the need for the user to divert his or her attention 
to enter requests for information using a keyboard or other device, or to view a display 
to read the information returned as a result of the request. 

1 0 Fig. 2 shows an embodiment of the present invention for a mobile information 

network browser system 200 with voice recognition and feedback capability, 
including wireless communication network 202, voice interaction system (VIS) 204, 
and mobile audio device 208, content server 210, personalization server 212, remote 
servers 214, information network 216, conventional telephone system 218, cellular 

15 telephone system 220, and computer system 222. VIS 204 incorporates a voice 
recognition system that deciphers a user's voice input and recognizes when a user 
inputs a browser command. 

There are a number of alternatives for providing a user interface for 
controlling information network browser 114 and retrieving information from the 

20 information system 216 that may be utilized with the present invention. In one 
embodiment, content server 210 incorporates VIS 204 and voice navigation 
commands are transmitted to and executed by content server 210. In another 
embodiment, VIS 204 is a separate system that resides outside of any of the other 
components of mobile information network browser system 200. In another 

25 embodiment, VIS 204 is built into a component of wireless communication network 
202 such as cellular telephone system 220, and transmits commands to content server 
210, which executes the command. In another embodiment, mobile audio device 208 
includes VIS 204 and transmits recognized commands to content server 210. 
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Browser 114 performs functions including navigation and data output. 
Navigation determines what information the user is interested in retrieving. Data 
output presents the retrieved information in a format legible to the user. In the present 
invention, the output is usually voice. However, another embodiment of the present 
5 invention includes the capability to additionally output the responsive information to a 
text file, to a printer, and/or to a facsimile device. In an embodiment of the present 
invention wherein mobile audio device 208 includes voice recognition, mobile audio 
device 208 also performs navigation functions of browser 1 14 to determine which 
commands to send to content server 210 to retrieve the requested information. In this 
10 embodiment, control switches, such as buttons and dials, are provided to allow the 
user to enter navigation commands and browser control selections. Control switch 
selections are converted to information requests or browser controls by program 
instructions in mobile audio device 208 and transmitted as commands to content 
server 210 via wireless communication network 202. 

15 It is important to note that a user's listening preferences and requests may be 

preprogrammed, or set to default values, and therefore user input is not required for 
the present invention to request information from information network 216. The user 
may, however, override preprogrammed and default requests and settings using voice 
input. The user may also provide voice input to reset information requests to default 

20 values and/or to request information in addition to the information requested by the 
preprogrammed or default settings. As used herein, the term "requested information" 
pertains to information that is requested by mobile audio device 208, whether the 
request is the result of user input or preselected/default settings for mobile audio 
device 208. 

25 Fig. 3a shows a flowchart of one embodiment of logic that may be used in 

mobile audio device 208 for handling input from a user to browse information 
available from information network 216. Referring now to Figs. 2 and 3a, program 
instructions associated with mobile audio device 208 wait for input from a user as 
shown at block 302. When input is received, mobile audio device 208 stops 

30 outputting information from previous requests (if applicable), as shown at block 304. 
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When mobile audio device 208 includes voice recognition capability (as shown by 
dashed box 306), it processes the user's speech to determine whether a valid 
command was entered and converts the analog signal to digital samples of the analog 
signal at a prescribed rate as shown in block 308 to generate a processed signal 
5 representing the user's voice input. Mobile audio device 208 may also include 

capability to compress and/or encrypt the digital samples of the user's input as shown 
in block 310, using one of any known compression and/or encryption algorithms. The 
processed signal representing the user's input is output to wireless communication 
network 202 as shown in block 312. Wireless communicate network 202 then 
10 transmits the processed signal to VIS 204 as shown in block 314. Once the user input 
signals are transmitted, the program instructions loop back to block 302 and wait for 
more input from the user. 

Referring now to Figs. 2 and 3b, Fig. 3b shows a flowchart of one embodiment 
of logic that may be used in mobile audio device 208 for providing requested 

1 5 information from servers 210, 212, 214 in the form of audio output to the user. 

Information responsive to a user's request is transmitted from servers 210, 212, 214 to 
VIS 204. As shown in block 320, VIS 204 transmits the information in an appropriate 
format to mobile audio device 208 via wireless communication network 202. Logic 
contained in program instructions in mobile audio device 208 suspend execution of 

20 further program instructions related to processing responsive information until the 
responsive information is received, as shown in block 322. As the responsive 
information is received, it is buffered, or stored, as shown in block 324, until it is 
requested for data processing. Mobile audio device 208 is capable of processing data 
at a rate that minimizes discontinuity or interruptions in outputting the information to 

25 audio output devices. When the responsive information is compressed and/or 
encrypted, it is correspondingly decompressed and/or decrypted in mobile audio 
device 208 as shown in block 326. The responsive information comprising textual 
data is then translated from text to speech, and then transmitted to an audio output 
device as shown in blocks 328 and 332. Responsive information comprising digital 

30 voice data is converted from digital to analog signals which are then transmitted to an 
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audio output device as shown in blocks 330 and 332. Once the analog audio output 
signals are transmitted, the program instructions loop back to block 322 and wait for 
data from VIS 204. 

Referring now to Figs. 2 and 4, Fig. 4 shows a flowchart 400 of one 
5 embodiment of logic that is used in VIS 204. The logic is implemented in program 
instructions that are executed to allow a user to log in and enter personal information 
in personalization server 212, recognize voice commands, transmit the appropriate 
data selections and navigation commands to content server 210, receive responsive 
information from content server 210, and transmit the responsive information to 

10 mobile audio device 208 via wireless communication network 202. As shown in 
block 402, mobile audio device 208 transmits user input to VIS 204 via wireless 
communication network 202. Logic contained in program instructions in VIS 204 
suspends execution of further program instructions related to processing user input 
until the user input is received, as shown in block 404. As the user input is received, 

15 it is translated from voice to an input command signal in block 406. 

The input command is analyzed, as shown in block 408, and the appropriate 
program instructions are executed corresponding to the command input by the user. 
When a user first accesses VIS 204, the system verifies that the user is authorized to 
access the system. This may be accomplished in one of several known ways. In one 

20 embodiment, each user is assigned a password which must be entered and verified 
before access to the system is granted. One example of an implementation for 
verifying a user's password is shown in blocks 410 through 416. Specifically, on first 
access, the user's password is retrieved from personalization server 212 as shown in 
block 410, and compared to the password entered by the user, as shown in block 412. 

25 If the user's input matches the retrieved password, the user is successfully logged in 
and control passes from block 414 back to block 408 to request the user's main menu. 
If the passwords do not match, a login error is issued as shown in block 416. 
Optionally, the user may be prompted again, up to a predetermined number of times, 
to enter a password. 
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Once control passes to block 418, the user's personalized menu is retrieved 
from personalization server 212, and stored in memory as shown in block 420. 
Program instructions, corresponding to block 422 and 424, translate the stored menu 
from text data to digital voice data. The digital voice data is then compressed and/or 
5 encrypted in block 426 and transmitted to mobile audio device 208 via wireless 
communication network 202 as shown in block 428. Once the digital data is 
transmitted, control is passed to block 404 to wait for input from the user. Note that 
control is passed to block 41 8 on the first access to retrieve the main menu, whether it 
is a user's customized menu or the default menu. Control is also passed to block 418 
1 0 whenever the user inputs a menu request for either the main menu or one of a variety 
of sub-menus, which the user may also personalize. 

When the user enters a request for information, control is passed from block 
408 to block 430, wherein VIS 204 issues a request for information to content server 
210. The requested information is retrieved from content server 210, or from servers 

15 214 if the requested information does not reside on content server 210. Program 

instructions, corresponding to blocks 422 and 424, translate the requested information 
from text data to digital voice data. The digital voice data is then compressed and/or 
encrypted in block 426 and transmitted to mobile audio device 208 via wireless 
communication network 202 as shown in block 428. Once the digital data is 

20 transmitted, control is passed to block 404 to wait for input from the user. 

Referring now to Figs. 2 and 5, Fig. 5 shows personalization logic 500 
implemented in program instructions for accessing information on personalization 
server 212. Program instructions corresponding to block 502 suspend execution of 
further program instructions to access personal information until a request is received 

25 from VIS 204. Once a request for personal information is received, program 

instructions access a database of user information as shown in block 504. The user's 
information and customized settings are retrieved from the database by indexing 
through the information based on the user's identification as shown in blocks 506 and 
508. The data corresponding to the user's personal information and settings are then 

30 transmitted to VIS 204, either directly or through content server 210. Some of the 
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personal information may be stored in content server 210 and/or in VIS 204 for use in 
filtering and presenting information gathered in response to a user's request. Once the 
personalization information is transmitted, control is passed to block 502 to wait for 
another request for a user's personal information. Note that in an alternative 
5 embodiment, some or all of the personalization program instructions may be 

implemented in mobile audio device 208 to tailor information requests and playback 
of the responsive information. 

Referring now to Figs. 2 and 6, logic implemented in program instructions for 
accessing information on content server 210 and remote servers 214, if necessary, is 

10 shown in Fig. 6. Program instructions corresponding to block 602 .suspend execution 
of further program instructions to access information on servers 210, 214 until a 
request is received from VIS 204. Once a request for information is received, 
program instructions search a database on content server 210 as shown in block 604. 
If the information requested is found on content server's 210 database, the 

15 information is retrieved from the database and transmitted to VIS 204 as shown in 
block 606. Once the requested information is transmitted, program instructions pass 
control to block 602 to wait for another request for information. If the information 
requested is not found on content server's 210 database, program instructions on 
content server 210 issue a search for the information on remote servers 214 through 

20 information network 216, as shown in block 608. The information is retrieved from 
one or more servers 214, translated from a markup language, such as HTML, to text, 
and stored in a database on content server 210, as shown in blocks 610, 612, and 614. 
The information, in text format, is then transmitted to VIS 204. Once the information 
is transmitted, control is passed to block 602 to wait for another request for 

25 information. 

Referring now to Figs. 2 and 7, Fig. 7 shows a block diagram of components 
included in one embodiment of mobile audio device 208 including communication 
interface 700 and audio interface 702. Mobile audio device 208 receives audio input 
signals through microphone 704 from a user, processes user input signals as required 
30 through analog to digital converter 706 and compression/encryption unit 708, and 

- 13- 

548999 v3 



Atton^^cketNo.: M-7844 US 

transmits processed user input signal 710 to communication interface 700. When 
conventional telephone system 218 is used, data is transferred via modem 712. 
Mobile audio device 208 also receives data signal 714 representing responsive 
information from communication interface 700 and processes it in audio interface 702 
5 to generate one or more audio output signals 716, 718, 720, 722, 723 that are 

transmitted to corresponding audio output devices including, for example, signal line 
724 direct-wired to car radio 726, wireless short-range radio 728 that broadcasts to car 
radio 726 on a selected channel, speaker 730, headphones 732, or cassette adapter 
733, respectively. 

10 Audio interface 702 exchanges input and output data signals with wireless 

communication network 202 via communication interface 700. Wireless 
communication network 202 may be one or a combination of any known wireless 
communication systems such as a satellite communication network or a cellular 
communication network that provides a communication link between VIS 204 and 

15 mobile audio device 208. 

Audio interface 702 includes audio converter 734, which receives from 
communication interface 700 through input buffer 736 information responsive to a 
user's request. The information responsive to the user's request may be specific 
information requested by the user, or it may be information that should be presented 
20 to the user, such as error or status messages, even though it was not specifically 

requested. Input buffer 736 is used to store the information until audio converter 734 
is ready to process it, thereby improving the continuity of the audio transmission to 
the user. Additionally, input buffer 736 allows the information to be stored when the 
user interrupts playback, such as by issuing a pause command. 

25 When the information received is stored in a compressed format, it is routed 

through decryption/decompression unit 738 before being sent to audio converter 734. 
Audio converter 734 converts the responsive information to audio signals 716, 718, 
720, 722, 723 for output to a respective audio output device 724, 726, 728, 730, 732, 
733. Thus, in addition to car stereos, the present invention may be utilized to deliver 
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responsive information using many types of devices that include a built-in speaker 
730 and/or headphones 732, including cellular telephones and other personal 
communication devices. Further, a combination of output devices may also be used, 
such as a cellular telephone that is configured to deliver audio signals to car radio 726, 
headphones 732, and/or speaker 730. 

In one embodiment, mobile audio device 208 includes one or more data 
processors 740, such as microprocessor 740, that executes software instructions to 
perform a variety of tasks including controlling transmission and reception of data 
messages and converting data messages to desired formats. The data processing 
associated with mobile audio device 208 may additionally be divided among several 
components having a dedicated data processor and program instructions to perform 
the tasks required of the component. Examples of components in mobile audio device 
208 that may include a data processor are decryption/decompression unit 738, input 
buffer 736, audio converter 734, analog to digital (A/D) converter 706, and 
compression unit 708. 

In another embodiment, mobile audio device 208 is a standalone device that 
may be located in the mobile vehicle or machine, or at a stationary location with the 
ability to transmit audio output signals 716, 718, 720, 722, 723 to one or more audio 
output devices 724, 726, 728, 730, 732, 734. Alternatively, mobile audio device 208 
may be incorporated in other components of network browser system 200 such as car 
radio 726, cellular telephone 220, wireless communication system 202, or VIS 204. 

In another embodiment, control switches 742, such as buttons and dials, are 
provided to allow the user to enter browser navigation commands and browser control 
selections. Control switch selections are converted to information requests or browser 
controls by program instructions in data processor 740. 

Wireless data that is transmitted to mobile audio device 208 may be in one of 
several formats depending on the transmission protocol being utilized. These formats 
include, but are not limited to, circuit-switched voice 746, circuit-switched data 748, 
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and packet/cell-switched data 740. Circuit-switched voice 746 and circuit switched 
data 748 are transmitted using a circuit switching technique where a circuit between 
the calling and called stations is physically established on demand, for the exclusive 
use by the two stations, until the connection is released. A packet is a group of bits 
5 switched as a unit for transmission over a shared network and is the basic unit of 
transmission in a packet-switched network. Packet-switched data 740 is transmitted 
using a transmission protocol in which data is segmented into packets that can be 
individually addressed and routed through the network, possibly using several 
different routes. The sequence of the packets is maintained and the destination 

10 established by the exchange of control information, contained in the packets, between 
the sending terminal and the network before the transmission starts. The receiving- 
end node determines that all packets are received and in the proper sequence before 
forwarding the reassembled message to the addressee. Packet switching allows 
facility sharing by many users. Packets can be routed individually over the best 

1 5 available network connection in a packet switching network, and reassembled to form 
a complete message at the destination. Control information is carried in the packet, 
along with the data, to provide for addressing sequence, flow control, and error 
control at each of several protocol levels. A packet can be of fixed or variable length, 
but usually has a specified maximum length of 1024 bits. Cell switched data is 

20 similar to packet-switched data, except it is transmitted using a different transmission 
protocol. 

For circuit-switched voice 746, VIS 204 replays the responsive information 
directly when the information is in pre-recorded audio format. When the information 
is in text format, VIS 204 converts the text to a speech format, based on the 

25 requirements of the particular audio output device. VIS 204 is capable of converting a 
variety of different text formats to a variety of different audio formats. The formatted 
information is transmitted to mobile audio device 208, which includes one or more 
data processors 740 that perform the required processing to format the information for 
transmission to audio converter 734. Audio converter 734 also includes a data 

30 processor for processing the information for output to the audio output device. 
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Circuit-switched data 748 is sent to mobile audio device 208 either as 
compressed digital audio data or as digital data representing text. Compressed digital 
data is transmitted to input buffer 736, and converted to a decompressed format by 
decryption/decompression unit 738. Audio converter 734 converts the decompressed 
5 information to one or more audio output signals 716, 718, 720, 722, 723 for output to 
one or more audio output devices 724, 726, 728, 730, 732, 734. 

For packet-switched and cell-switched data, the information is transmitted 
similar to the transmission of circuit-switched data, except that a packet-switched or 
cell-switched data transmission protocol is used between content server 210, VIS 204, 
10 and wireless communication network 202. Packet-switched and cell-switched data is 
most likely to be used between content server 210, VIS 204, and wireless 
communication network 202 in the present invention using wireless communication 
networks 202 currently available. 

Alternatively, or in addition to wireless data, the responsive information may 
15 be transmitted via conventional telephone system 218 through telephone line 752. 

Another alternative is providing responsive information from a disk on disk drive 754. 
The information on disk drive 754 may have been stored during a previous session, 
and is thus available for playback at a later time by the user. 

Notably, radio 726 may be any type of a radio capable of being used in a 
20 mobile vehicle, and the present invention is particularly suitable for use with a car's 
existing built-in stereo system. One embodiment of the present invention utilizes a 
short-range AM/FM radio transmitter. In this embodiment wireless communication 
network 202 communicates with mobile audio device 208 using a cellular or satellite 
network, and mobile audio device 208 broadcasts the information using short-range 
25 AM/FM signals to a pre-selected AM/FM frequency that is received by car radio 726 
(e.g., a built-in car radio). Another embodiment of the present invention provides 
signals to radio 726 from audio converter 734 via a direct electrical connection to 
standard input plugs such as CD, FM or line-in. Still another embodiment of the 
present invention includes an adapter device, such as cassette adapter , that is operable 
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to receive signals from car radio 726 and output them to a recording device for storing 
the responsive information on a storage medium. The responsive information may 
then be played back at the user's convenience. 

Content aggregation server 2 1 0 includes one or more computer systems that 
5 aggregate information retrieved from remote servers 214, as requested by the user. 
The information is stored as compressed or uncompressed digital voice format, text 
format, or any other applicable format that may be used to represent the information. 
Servers 210,212,214 are connected to information network 216 via a high-speed 
connection, and can quickly retrieve information from one of servers 214 if the 
10 information requested is not found on local content aggregation server 210. 

Personalization server 212 includes one or more computer systems that are 
used to store personal information about users. One embodiment of the present 
invention allows the user to customize the information broadcast from the wireless 
network over the car radio or other audio output device. The user may also customize 

1 5 menus and select options for presenting the responsive information, or the user may 
alternatively use a default set of selections that are available to all users. Personal 
information may include, but is not limited to, user name, password, information 
preferences such as, for example, a list of stocks for which current stock market price 
is desired, and news information sources to utilize. The user may enter preferences 

20 using microphone 704, conventional telephone system 218, cellular telephone system 
220, or computer system 222 connected to personalization server 212 through 
information network 216. 

VIS 204 is operable to recognize commands from a user's speech for 
interaction with content aggregation server 210, personalization server 212, as well as 
25 remote servers 214 through information network 216. An example of a voice 

recognition system 800 suitable for use with the present invention is shown in Fig. 8. 
Such a voice recognition system may be used for a variety of purposes including 
inputting data and commands to an information network browser program or 
electronic mail program, and controlling operation of a device. Voice recognition 
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system 800 may be tailored to a specific use and therefore may be programmed to 
recognize and respond to certain words or phrases as being valid system commands or 
input. Such words and phrases are typically determined arid implemented before 
voice recognition system 800 is deployed; however, voice recognition system 800 
5 may also have the capability to adapt to changed conditions, such as, for example, to 
dynamically adjust to a change or substitution of hardware components, including 
switching between wireless telephone 802, microphone 804, and conventional 
telephone system 806 for input. 

Referring now to Figs. 2 and 8, VIS 204 is implemented on a data processing 
1 0 system, which may be one of several different types of data processing systems 

including, for example, mainframes, minicomputers, workstations, servers, personal 
computers, Internet terminals, laptop computers, palmtop computers, and embedded 
systems. The data processing system may be one of many workstations connected to 
a network such as a local area network (LAN), a wide area network (WAN), and/or 
1 5 information network 216. 

A user's voice is input to a speech input device, such as wireless telephone 
802, microphone 804, or conventional telephone 806, which, depending on the device, 
generates an analog or a digital input signal representing the acoustic wave input of 
the user's natural speech. The analog input signals are coded as speech data using an 

20 appropriate speech input processor 808, 810. Speech data can be coded as, for 
example, Adaptive Differential Pulse Coded Modulation (ADPCM) using 
commercially available modulation devices. In addition, or alternatively, speech data 
may be transferred coded as Linear Predictive Coding (LPC) parameters or other 
parameters achieving low bit rates (e.g. 4.8 Kbits/second), or using a compressed 

25 format, such as, for example, MPEG 1 layer 3 (MP3). 

For an input device that provides an analog signal, speech input processors 
808, 810 convert the analog signal to digital samples of the analog signal at a 
prescribed rate, and transmit the digital samples as electrical signals representing the 
speaker's voice. For an input device that provides signals that are already in digital 
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format, such as wireless telephone 802, the voice signals are already sampled at 
regular, short intervals, to create a digital representation of the original voice wave. 
Speech input processor 812 next processes the digitized voice, resulting in a 



5 speaker's voice are input to VIS 204, which processes and analyzes the digital signals. 
It is important to note that VIS 204 may receive voice input in analog format, in 
which case it performs standard voice recognition. In other implementations, VIS 204 
may receive the voice in a compressed/encrypted digital format, in which case VIS 
204 would have to decrypt, decompress, and convert the signal to an analog signal 
10 before processing voice recognition. 

During operation, VIS 204 utilizes speech analysis unit 820, which includes 
program instructions that may be embodied in one or more executable modules that 
are executed as required. The program instructions are commercially available and 
may perform several processing functions including echo cancellation 822, signal 
15 processing 824, barge-in 826, speech recognition 828, and speech generation 830. 

Echo cancellation 822 removes echoes caused by delays (e.g., in a 
telecommunications network) or reflections from acoustic waves in the immediate 
environment. This provides higher quality speech for recognition and processing by 



one embodiment, barge-in 826 may distinguish human speech from ambient 
background noise. Barge-in 826 is optional, and therefore, may not be present in 
every implementation. 

Signal processing 824 performs signal processing operations which, among 
25 other things, may include transforming speech data received in time domain format 
(such as ADPCM) into a series of feature parameters such as, for example, standard 
cepstral coefficients, Fourier coefficients, LPC coefficients, or other parameters in the 
time or frequency domain. For example, in one embodiment, signal processing 



compressed representation of the digital voice signal. 



The signals representing the 



VIS 204. 



20 



Barge-in 826 may detect speech received at speech input coders 808, 810. In 
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If 



component 824 may produce a twelve-dimensional vector of cepstral coefficients 
every 10 milliseconds to model speech input data. Software for implementing signal 
processing 824 is commercially available from line card manufacturers and automated 
speech recognition (ASR) suppliers. 

5 Speech recognition 828 recognizes vocalized speech input from speech input 

signals. As shown, speech recognition 828 may comprise an acoustic model 
component and a grammar component. The acoustic model component may comprise 
one or more reference voice templates which store previous enunciations, or acoustic 
models, of certain words or phrases by particular users. Acoustic model component 

1 0 recognizes the speech of the same users based upon their previous enunciations stored 
in the reference voice templates. The grammar component may specify certain words, 
phrases, and/or sentences which are to be recognized if spoken by a user. Recognition 
grammars for the grammar component can be defined in a grammar definition 
language (GDL), and the recognition grammars specified in GDL can then be 

15 automatically translated into machine executable grammars. In one embodiment, the 
grammar component may also perform natural language processing. Hardware and/or 
software for implementing recognition grammars is commercially available from a 
number of vendors and can typically be modified for particular applications. 

Speech generation 830 generates speech data representing responses to 
20 information requests, prompts, or other messages, which is intended to be heard by a 
user. Speech generation 830 comprises a text-to-speech (TTS) component which 
synthesizes human speech by "speaking" text, such as that contained in a textual 
HTML document. The text-to-speech component may utilize one or more synthetic 
speech mark-up files for determining, or containing, the speech to be synthesized. 
25 Software for implementing the text-to-speech component is commercially available 
from a number of companies. 

Fig. 9 shows another embodiment of the present invention of a system 900 
with position-keeping and voice recognition and feedback capability for browsing an 
information network. System 900 includes components similar to the embodiment 
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shown in Fig. 2, with the addition of location server 902 and position-keeping 
capabilities to provide the location of mobile audio device 904. The position-keeping 
capabilities may be provided by one or more of several known systems for supplying 
the location of a movable object. Suoh systems include, but are not limited to, global 
5 positioning systems (GPS), inertial navigation systems, triangulation systems using 
signals from wireless communication network 906, and dead reckoning navigation 
systems. The position-keeping system may provide coordinates of mobile audio 
device 904 in any system desired including Cartesian (x, y, z) coordinates with 
respect to a known reference point, or latitude/longitude/altitude/heading with respect 
10 to the known earth navigation system. 

The position-keeping system, or components of the position-keeping system, 
is included in one or more of any appropriate components comprising the present 
invention. For example, a GPS receiver may be included in mobile audio device 904 
to receive the coordinates of mobile audio device 904 from a GPS satellite network as 
1 5 the mobile audio device 904 moves from location to location. The particular 

components included in any given positioning-keeping system and their function will 
dictate the most appropriate component in the present invention in which to include a 
particular component of the position-keeping system. 

Location server 902 communicates with wireless communication network 906, 
20 content server 908, and personalization server 910. The coordinates of mobile audio 
device 904 are transmitted to location server 902 via wireless communication network 
906. Location server 902 may then transmit location information to content server 
908 and/or personalization server 910 to be used in providing a wide variety of 
personalized location-specific information to the user. For example, a user having an 
25 automobile equipped with mobile audio device 904 may personalize his or her profile 
so that the names of restaurants within a 5-mile radius of his or her specific location 
are provided when requesting locations of local restaurants. Another example is to 
use the location information to provide driving instructions to a requested destination. 
Such a system may be integrated with position-keeping and navigation systems 
30 available in some models of automobiles. It will be apparent to one skilled in the art 
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that the location-specific information may be used to provide virtually any type of 
location-related information to the user. 

In another embodiment, mobile audio device 904 includes capability to detect 
and compensate for data transmission errors in wireless communication network 906. 
5 Such capability utilizes location information to determine when mobile audio device 
904 is coming near an area covered by wireless communication network 906 where 
there is a high incidence of data loss due to propagation errors caused by such factors 
as atmospheric effects, the presence of earth bulge, and the effects of trees, buildings, 
and hills which exist in, or close to, the transmission path. This information is stored 

10 in a database, and the error detection/compensation routine compares the location of 
the mobile audio device 904 to error information in the database. When mobile audio 
device 904 is likely to experience a data loss rate that is higher than a pre-selected 
value, one of several options may be taken including informing the user of the 
likelihood of errors or gaps in the information, asking the user if they would prefer to 

1 5 wait for the information until transmission of the data will be more reliable, or 
buffering a greater than normal amount of information to be able to continue 
undisrupted output until the connection is re-established. 

One skilled in the art will recognize that the functions performed by location 
server 902 may be integrated in another server connected to information network 912, 
20 such as content server 908, thereby eliminating the need for a separate server for 
location server 902. 

Fig. 10 shows a block diagram of an embodiment of mobile audio device 904 
with location processor 1002. Mobile audio device 904 corresponds to the system 
900 with position-keeping and voice recognition and feedback capability for browsing 
25 an information network in Fig. 9. Location processor 1002 may be a dedicated data 
processor such as an application-specific integrated circuit (ASIC) designed 
specifically to handle location data, or the location data may be processed in another 
data processor that is also used for other purposes in mobile audio device 904. 
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Fig. 1 1 shows a schematic diagram of one embodiment of the present 
invention for mobile audio device 1 100 that is designed as an adapter to a mobile 
telephone. Mobile audio device 1 100 may receive power through adapter plug 1 102 
when adapter plug 1 102 is plugged into an automobile's cigarette lighter receptacle. 
5 Alternatively, power may be supplied by the mobile telephone's battery through 

voltage regulators 1 104 and 1 106 at 5 volts and 3.3 volts, respectively. When adapter 
plug 1 102 is plugged into a cigarette lighter receptacle, battery charger 1 108 provides 
recharging power from the automobile to the mobile telephone's battery back. A 
modem link is established between mobile audio device 1 100 and the mobile 

1 0 telephone through connector 1110, which may be one of any suitable type of interface 
connectors known in the art for transmitting data and power signals, such as RS232 
data communication at 1 15.2k baud using TCP/IP connection protocol. Battery 
charger 1 108 may be eliminated when mobile audio device 1 100 is used with a mobile 
telephone that includes a 1 2 volt adapter and power is provided over the modem cable 

15 to mobile audio device 1 100. 

The mobile telephone establishes a communication line with information 
network 912 (Fig. 9) through wireless communication network 202 (Fig. 7). 
Transceiver 1112 provides two-way communication between data signals from 
connector 1110 and digital signal processor (DSR) 1114, such data including requests 

20 for information from DSP 1114, and information responsive to requested information 
from information network 912. DSP 1114 executes software instructions to perform a 
variety of tasks including controlling transmission and reception of data messages and 
converting data messages to desired formats. DSP 1114 may also be used to perform 
speech recognition and voice decompression functions. Memory devices, such as 

25 static ram memory device 1116 and flash memory device 1118 are coupled to DSP 
1 1 14 to provide data storage. DSP 1 1 14 is also coupled to receive input from push 
button control switch 1 120 which may be used in one or more ways to control 
operation of mobile audio device 1 100. For example, a single quick push of switch 
1 120 causes the telephone to dial a pre-programmed phone number for establishing 

30 communication with information network 912. A longer, several second push of 
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switch 1 120 causes mobile audio device 1 100 to enter a configuration mode to allow a 
user to set the FM output frequency and/or the pre-programmed telephone number for 
accessing information network 912. The numeric information is entered via the 
telephone's numeric keypad. Switch 1 120 may also be used to put mobile audio 
5 device 1 100 into a voice command mode, allowing hands-free selection and activation 
of pre-programmed information requests, audio volume control, and FM channel 
selection. Light emitting diode (LED) 1 122 provides one or more visual indicators of 
mobile audio device's 1 100 operational status. Note that other control switches may 
be used in addition or instead of switch 1 120 to control operation of mobile audio 
10 device 1 100. Alternatively, mobile audio device 1 100 could operate without switch 
1 1 20 by operating in a continuous speech recognition mode when powered on. 

Audio coder/decoder (codec) 1 124 is coupled for two-way communication 
with DSP 1114. Codec 1 124 also receives input from the user through the 
combination of microphone 1 126 and amplifier 1 128, and provides an audio output 
15 signal, such as output signals 716, 718, 720, 722, 723 in Fig. 7, to the audio output 
device, shown as a short-range FM transmitter 1130. Codec 1 124 performs data 
compression, encryption, decompression, and decryption, and also includes an input 
buffer for storing data. 

The embodiment of mobile audio device 1 100 shown in Fig. 1 may be 
20 packaged in a separate casing that is small enough to be hand-held or carried in a shirt 
pocket. The cigarette plug cable, the modem cable, and the microphone cable may be 
fixedly or removably attached to the casing. In one embodiment, mobile audio device 
1 100 operates under section 15.239 of the Federal Communication Commission 
(FCC) regulations, which provides for unlicensed operation in the FM broadcast band. 

25 While the invention has been described with respect to the embodiments and 

variations set forth above, these embodiments and variations are illustrative and the 
invention is not to be considered limited in scope to these embodiments and 
variations. For example, transmitting audio output signals 716, 718, 720, 722, 723 
may be performed by VIS 204, which takes the responsive information and converts it 
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to voice when text-to-speech conversion is required. Alternatively, when mobile 
audio device 208 includes text-to-speech technology, mobile audio device 208 
communicates directly with content server 210, effectively bypassing VIS 204. 
Accordingly, various other embodiments and modifications and improvements not 
described herein may be within the spirit and scope of the present invention, as 
defined by the following claims. 
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